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Abstract 

We define the Pascal Triangle of a discrete (gray scale) image as a pyramidal ar- 
rangement of complex-valued moments and we explore its geometric significance. In 
particular, we show that the entries of row k of this triangle correspond to the Fourier 
series coefficients of the moment of order k of the Radon transform of the image. Group 
actions on the plane can be naturally prolonged onto the entries of the Pascal Triangle. 
We study the prolongation of some common group actions, such as rotations and re- 
flections, and we propose simple tests for detecting equivalences and self-equivalences 
under these group actions. The motivating application of this work is the problem of 
recognizing "shapes" on images, for example characters, digits or simple graphics. 



1 Definition and Reconstruction Properties 



Let {(xk,yk)}k=i with Xk,yk £ K represent the pixel locations of a digital image. For sim- 
plicity, we use complex coordinates Zj. — x k + iy k . Consider a gray scale image defined 



on {zfc}fc=i- More specifically, we have a mapping p : {z k } 



N 

fe=l 



^>0 



, where p(z k ) repre- 



sents the intensity of pixel z k x . Denote the discrete gray scale image by I = { [z kl p(z k )) } 



N 



Consider the following moment matrix: 



tn(I) 



( /^0,0 ^1,0 

^0,1 ^1,1 

^0,2 ^1,2 
^0,3 



^2,0 ^0,3 
^2,1 • • • 



Hn-i,o \ 



NxN 



* School of Electrical and Computer Engineering, Purdue University. Email: mboutin@purdue.edu 

^Department of Mathematics, Purdue University. Email: huang94@purdue.edu 

1 We use R>o instead of a specific discrete domain such as {0, 1, . . . , 255} for more generality. 



where 



N 



Pit = z l z kP(zk), j, I e z> 



fc=l 



is the complex moment of order (j, I) for the discrete image I. Observe the conjugate sym- 
metry property of the moments /^y = pij. In particular, fj,jj G R, Vj G Z> . 



We can express the relationship between the moments and the image I in matrix form: 



t n (I) = Z ] WZ, 



(1) 



where 



(\ 



z 2 z 2 



\1 Z N Z 



N 



y N-V 
JV-1 



z N ~ 1 I 

Z N J 



w 



fp(zi) 

P(Z2) 



\ 







■•• \ 


p(z N )J 



and Z^ is the conjugate transpose of Z. Observe that Z is a Vandermonde matrix and there- 
fore is invertible when the pixel locations Zk are pairwise distinct. Therefore, if the pixel 
coordinates are known and pairwise distinct, one can reconstruct the image I by matrix 
inversion: W = {Z'^r^Z' 1 . 

Definition 1. Let r be a nonnegative integer and let I be a discrete gray scale image. The 
Pascal Triangle T r (I) of order r of I is the following pyramid: 

Po,o 
Po,i Pl,0 

p0,2 2/ix ! /i 2 ,0 
^0,3 ^>Pl,2 3/^2,1 ^3,0 
^0,4 4/ii )3 6/i 2 ,2 4/i 3j i /i 4j0 



l,r-l 



(1) Pi 



r-l ' • ' 



(r- l) Pr-1,1 Pr,0 



Lemma 1 (Pixel Intensity Reconstruction Property). If the grid point locations {zk}^_ 1 are 
known and pairwise distinct, then the image I can be reconstructed from the Pascal Triangle 
T^" 1 ^) of order N — 1. More specifically, knowledge of the entries of the right diagonal row 
o/T Ar_1 (7) ; i.e. {pj,o} N = Q , is sufficient for image reconstruction. 
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Proof. Recall the definition of the moments 



N 



k=i 



We consider the vector formed by the moments {p>j,o}j=o > which can be written in matrix 



form as 



A*o,o 
Pi,o 

A*2,0 



\fJ>N-l,0/ 



( 1 



Z'2 



JV-1 N-l 



1 \ 



/-I / 
N / 



(2) 



Observe that the coefficient matrix in ([2]) is a Vandermonde matrix. The Vandermonde 
matrix has full rank when Zj ^ z^ for all distinct j,k = 1, 2, . . . , N. Thus, since the pixel 
locations are assumed to be distinct, we can reconstruct the pixel intensities {p(zk)}^_ 1 
by inverting the coefficient matrix and multiplying by the moment vector on the left-hand- 
side. □ 

Notice that if we consider the Pascal Triangle T N (I) of order N, then knowledge of the 
second right diagonal row of T N (I), i.e. { } J=0 ' * s a ^ so sufficient for image reconstruction 
as long as the z^s are pairwise distinct and nonzero. This is because the vector formed by 
the moments {pj,i}j=Q can be written in matrix form as 



Po,i \ 


( Zl 


z 2 


ZN \ 


Pl,l 


Z\Zi 


z 2 z 2 


Z N Z N 


P2,l 


z\zx 


z\z 2 


z 2 N z N 


N-l,lJ 


\ z l z l 


z 2 z 2 


■ z N Z N J 



( 1 



z 2 



\ z i 



N-l JV-l 



1 \ 

Zjsi 

N 



y N-l . 



fp( z l)\ 

Pi z 2] 

\p( z n)J 



(zt ••• \ ( p{z x )\ 
z 2 ■■■ 







• • • ZN J 



p(z 2 ) 

\p( z n)J 



(3) 



(4) 



The coefficient matrix in (j3J) is a Vandermonde matrix multiplied by a diagonal matrix. As- 
suming that the pixel locations are pairwise distinct insures that the Vandermonde matrix 
is invertible, and further assuming that they are nonzero insures invertibility of the diagonal 
matrix. Hence the coefficient matrix in ([3]) is nonsingular and we can reconstruct the pixel 
intensities {p(zk)} k _ x from T N (I) by inverting this coefficient matrix and multiplying by the 



3 



moment vector on the left-hand-side. 

A similar argument can be used to show that, for any fixed I, the pixel intensities can be 
reconstructed from the moment vector {jUjy} ._ , which can be obtained from the Pascal 
Triangle T N+l -\I) of order N + 1-1. 

Remark: In practice, when reconstructing the pixel intensities of an image /, floating point 
errors in the matrix inversion can result in inaccuracies in the reconstructed image. In fact, 
the recovered pixel intensities may be complex valued. While the imaginary part of the re- 
sult tends to be quite small, it is advantageous to first reformulate the problem to guarantee 
a real solution. One way to force the solution to be real is to separate Equation (jSJ) into 
two sets of equations with real coefficients. More specifically, we can separate the equation 
system into its real part and its imaginary part, and combine these two real equation systems 
into one. After this, a real solution for the new equation system can be found, for example, 
by Singular Value Decomposition (SVD). 

Lemma 2. 2 Given the moments matrix Tn(I) of a discrete image I and an upper bound on 
the number N of pixels, one can reconstruct the pixel location and the intensity p(zk) for 
all Zk such that p{zk) ^ 0. 

Proof. If the number of pixels in the image I is strictly less than N, we can extend I to an 
image with N pixels by adding zero intensity pixels. Without loss of generality, we assume 
that p(zk) 7^ for k = 1, . . . , s and p(zk) = for k = s + 1, . . . , N. Consider the polynomial 

s s 

p(t)=n(t-z k )=t s +Y,cjt s - j , (5) 

k=l j=l 

where the coefficients Cj are polynomials in the z^s. 

Observe that P(zk) = 0, Wk = 1, 2, . . . , s. Therefore, we also have p(zk)z l k P(zk) = 0, for any 
I = 0, . . . , s — 1. Summing all these equations over fc's, we get 

2 This result generalizes Proposition 1 in jT], which states that the vertices of a polygon are uniquely 
determined by a finite number of moments. 
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J2p(zk)z l k P(z k ) = 0, 

k=l 

s s 

^P^kHizi + ^CjzP) = 0, 



k=l 

s 



3=1 

s s 



3=1 k=l 



Z k) z k Z k 3 



0. 



k=l 

s 



0. 



c jps-j,< 

3=1 



-Ps,l, J = 0,1, 



s-1. 



We write these last equations in matrix form: 

/ ^0,0 ^1,0 7^2,0 ^0,3 ■ • 

p0,l P>1,1 p2,l 

p0,2 Pl,2 
Po,3 



\A*0,s-l pl,s-l 



Ps-1,0 \ 
Ps-1,1 
ps-1,2 
Ps-1,3 

P>s-l,s-l J 



I C 8 \ 

C s -1 
Cs-2 



V pi y 



/ AM \ 

AV 

Ps,2 
\Ps,s-lJ 



Ts(I) 



From Equation (JTJ) we know that 



/ 1 1 

zi ^2 



vr 1 4- 1 



1 \ 



7 



zi, 







V 



pW> 







\ /1 





p{z s )) 



Z\ z{ 
1 z 2 z\ 



V 



Zc Z c 



(6) 



s-l 



Thus t s (I) is invertible, since the locations z k are pairwise distinct and the pixel intensities 
p(zk) are nonzero. Hence we can solve the above equation system for (c s , c s _i, . . . , C\) by 
inverting T a (I) and multiplying by the vector on the right-hand-side of Equation ([6]). 

Since the c^'s determine the polynomial P(t), we can solve for the roots of P(t) = 0, which are 
actually {zk} k=1 - By LemmalU we can subsequently obtain the pixel intensities {p{zk)} k=r 

~n 

Remark: To determine the number of nonzero pixels, we can look at the rank of 7jv(I). 
Since Tjf(P) = Z^WZ by Equation ([!]) and rank(Zt) = rank(Z) = N, rank(W) = s, we can 
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conclude that rank(r A r(/)) = s. 

Since the Pascal Triangle T 2N ~ 2 (I) of the image / contains all the information needed to 
recover tjv(7), we have the following corollary: 

Corollary 1 (Image Reconstruction Property). Given the Pascal Triangle T 2N ~ 2 (I) of a 
discrete image I, one can reconstruct both the grid point locations {z k }^_ 1 and the corre- 
sponding intensities {p(z k )^_ 1 for all those z k such that p(z k ) ^ 0. 

2 Relationship with the Radon Transform 

The Radon transform f$(r) is the projection of the image / = {{z k , p(z k ))^_ 1 onto the 
straight line through the origin with direction vector (cos(#) sin(0)) , i.e. 

fees' 

where S = {k\x k cos(#) + y k sin(0) = r, k — 1,2, ... , N}. Since fe(r) is a periodic function 
of 9 with period 2n, any of its nth order moment m n {6) is also periodic with period 2n. It 
turns out that, for any n — 0,1,2, ... , the coefficients of the Fourier series of m n {9) are given 
by the coefficients of row (n + 1) of T r (I) with r > n. 

Lemma 3. The nth order moment m n {6) of the radon transform f$(r) is given by the 
following linear combination of the (n + l)th row entries of the Pascal Triangle T r (I) with 
r > n: 

Proof. For n = 0, we have 

N N 

m o{&) = ^p{zk) = ^2p(z k )z° k z° k = no,o- 

k=l k=l 

For n > 0, we have 

N 

m n (0) = = £ {n(6)) n p(z k ), 

r k=l 

where r k {6) is the projection of the vector (x k , y k ) T onto the axis with angle 6 G (— ir, n] with 
respect to x-axis. More precisely, 

r k (9) = x k cos 9 + y k sin 9 = ^(z k e~ ie + z k e te ), VA; = 1, 2, . . . , N, 
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and therefore 



N 



fc=l 

N 1 

= Y.k {Zke ~ ie + ~ Zkel6) ^ p{Zk) -' 

k=l 

1 - 



fc=l 

TV 



2 « ( 
fc=l z=o 



^ \ J „-iW-n-l J(n-l)8 
I I z k e z k ' 



1 n / \ ^ 

fEu (E4-rV(*))e-'v<»-')», 

1=0 ^ ' fc=l 



1 n 

i=0 



i(n-2l)6 



□ 



Figure [T]and Figure |2] summarize the relationship between the Pascal Triangle and the Radon 
transform of an image when the pixel locations are known and unknown, respectively. Ob- 
serve that a smaller number of rows of the Pascal Triangle are needed in order to reconstruct 
the image than if the pixel locations were known. 



Radon transform 



{(z k ,p(z k ))}" =1 



fe(r) 



Corollary CD 



triangle of the 
complex moments 



Lemma [3] 



nth order 
moment 



T 2N -\I) 



{m n (9)} 2 n 



2N-2 




Figure 1: Relationship between the Pascal Triangle and the Radon transform of 
an image under the assumption that the pixel locations are unknown a priori. 



3 Image Reconstruction from Samples 

Lemma 4. The last row ofT n (I) can be reconstructed from n + 1 generic moment samples 
ra n (0i), rn n (9 2 ), . . . ,m n (0 n+ i). 
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Radon transform 



{p(z k )}^ =1 with z k fixed 



Lemma [T] 



triangle of the 
complex moments 



-iJV-l 



(I) 



Lemma [3] 



Mr) 



nth order 
moment 



Figure 2: Relationship between the Pascal Triangle and the Radon transform of 
an image under the assumption that the pixel locations z k are fixed and known 
a priori. 



Proof. We first write Equation (j7j) in matrix form: 



/ rn n (9 1 ) \ 
m n {9 2 ) 



\m n (9 n+1 )j 



,i{n-2l)Bi 
D i(n-2l)0 2 



-ind\ 
-in02 



\ 



( V0,n \ 



V 



a i{n-2l)9 n j, 



(?) Hl,n-l 

V /Vo / 

There is a unique solution for (po,n, ■ ■ ■ , (?) Pi,n-i, ■ ■ ■ , /Vo) ^ anc ^ on ^y ^ 
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det 



det 



/ gin^i _ _ _ gi(n— 2i)Si 

gin02 . . . gi(n— 2i)02 

y e in6» n+ i . _ . e i(n-2l)e n+ i 

/ e - indi ... 

e~ in92 ... 



c —in02 



\ /e 



/J 

i2ra0i 
i2n9 2 



e «46»i e i26»i A 



e i40 n+ i e i26» 



n+i x y 



det 



J2n6 2 



mi e i2d 1 j\ 



■i2e n 



^ 0, since e" ir ^ ^ 0, Vj = 1, . . . , n + 1. 



Observe that the above determinant is a Vandermonde determinant. It is nonzero if e %26j ^ 
e l29k for all distinct j, k = l,...,n + 1. Therefore, if the 9/s are such that e l26,J ^ e l29k 
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(thus the need to pick a generic sample set), we will get a unique solution for (fio,m ■ ■ ■ > 
(?) fJ>i, n -h • • • j fJ"n,o)- Hence we can reconstruct the last row of T n (I). □ 



Corollary 2. 3 Given the grid point locations {^j, i; we can reconstruct the discrete image 

I = { (z k , p{z k )) } k=1 from the radon transform /^(r), fe 2 (r), fe N (r) at N fixed generic 
angles #1, . . . , 9 N . 

Proof. From the given radon transform of the image at different angles, we can calculate the 
moments {m n (9k)\n = 0, . . . ,N— 1, k — 1, . . . , n+l|. The conclusion followed by combining 
Lemma [Hand Lemma [H □ 

The diagram of Figure [3]thus commutes. Note that, one could use a similar argument along 
with Corollary Q] to show that (2N— 1) generic observations of \m n {6j),j = 1, . . . , n+l} 2 _ 2 

would be needed to fully reconstruct the image { (zfc, p(zk)) }^ =1 with pixel positions z k 
unknown. 



p(zk) with fixed z k , k = 1,2, 



triangle of the 
complex moments 



Radon transform 

N 1 f dl (r)Je 2 (r) 

Corollary [2] 



5 Je N 



Lemma [T] 



Lemma [S] 



nth order 
moment 



T N -\I) 



Lemma H] 



{m n (9i), m n (9 2 ), . . .,m n (9 n+1 )} 



N-l 
n=0 



Figure 3: Relationship between the Pascal Triangle T N and the Radon trans- 
form. 



4 Prolongation of Group Actions on the Moments and 
Invariantization 

Let (G, ■) be a group acting on the complex plane: 

■:GxC — ► C 

(g, z)=g-z, \/g e G,z e C. 

3 This result generalizes Theorem 5.1 in 2[, which states that a quadrature domain can be uniquely 
reconstructed by the line integral projections at finite angles. 
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This induces a group transformation (G,o) of the discrete image / = {(zk, p( z k))} k _ v 
namely 

go { (z k , p{z k ))} N k=l = {(g- z k , p{z k )) } N k=v \/g G G. 
Then the induced transformation (G, *) on moments {pj,i}j.iei>o is 

N N 

9 * {/^,zLvez>o = 9* {E 44p(^)Lvez>o = (E^ ■ z k )° (j^) l p(z k )} jt i eZ > . 

k=l k=l 

In other words, the transformed moments are the moments of the transformed image. 

Example 1: Consider the action of G = C on C by translation 

(zq, z) i->- z + z , Mzq e G,Vz e C. 
Then the induced transformation on the image I = { {z kl p(z k )) } k _ 1 is 

zo o {(z k ,p(z k ))} k=1 = {(z k + z ,p(z k ))} k=v Wz eG. (8) 

In other words, the image is translated horizontally with distance xq = Re(zo) and vertically 
with uq = lm(zo). The transformed complex moments are 

N N 

hi = ^2^ l kp(^k) = E(** + z y{z k + z yp{z k ), 

k=l k=l 

= EE (T) 44~')(E (0 

k=l s=0 ^ ' t=0 ^ ' 

= EE(E^^*))(i) GH^" 

s=0 t=0 fe=l \ / \ / 

= E E ^ (I) U ) *o~*^ Vj, i G Z> . (9) 

Written in matrix form, the transformation of the moment matrix 7jy(J) is 

7*(J) = At rj v(/)A 

where A = (a^)jvxiv is an upper-triangular matrix with = (]z\) z l Q \ and is the 
conjugate transpose of A. 

Having obtained an explicit formula for the action of G on the moments, we follow Fels and 
Olver's moving frame method [3] to obtain a set of invariant functions of the moments. More 
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specifically, we consider the cross-section defined by /i^o = 0. The group transformation that 



Ml,0 

lit; — — 

frame to the moment matrix, we obtain the matrix 



maps 7jv(J) to the cross-section is the moving frame z = — By applying the moving 



f N (I) = Alr N (I)A , 

where A = ( (jZ\) (— j^Y ~ J ) NxN - By equivariance of the moving frame, all the entries of 
fjv(-0 are invariant under translation. One can check that theses entries jljj are actually the 
centralized moments 

N 

H,i = 5>* - — Y(zk - ^Yp(zk), j, l e Z >0 . (10) 
A*o,o ^0,0 

By normalizing (i.e. applying the moving frame transformation to) the coordinates of T r (I), 
we obtain the translation invariant Pascal Triangle T[ rans (I) for a discrete image /: 

Ao,i Ai,o 

A*Q,2 /i2,0 
/^0,3 3/2x,2 3/22,1 ^3,0 

Ao,4 4/2i )3 6/i 2 ,2 4/i 3)1 /2 4 ,o 



^0,7- (l) A*l,r-1 ' ' ' (j) /^,r-Z ' ' ' (r- i) fir-1,1 firfl 



Observe that the corresponding ra-th order central moment m n (8) of the image, 

TV 

™n(0) = ^2 ( r ' k ^ — r (6')) ri p(xfc, 2/fc), 

k=l 

where tq(6) = xq cos 6 + yo sin is the projection of the centroid, is invariant under transla- 
tions. 



Lemma 5 (Orbit Separation Property of T™ n ^(I)). Let h^h be two discrete gray scale 
images with the same number N of pixels. There exists a translation g £ C such that 
goI x = I 2 , where o is defined as in T[ rans (Ix) = T[ rans (I 2 ) for r > 2N - 2. 
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Proof. =>• If 3 g G G such that g o I x — I 2 , we have 2^ = z£ + an d P2( z k ) = Pi( z k)i 
for some ^ G C, k = 1, . . . , N. From Equation (Q we know that 

(2) (1) (2) (1) (1) 

Po,o ~~ Po,0' Pi,o ~~ Po.o^o t Pi t o- 

Hence 

(2) (1) 
Plfi _ Pl,0 

A*o,o Po,o 



Then applying Equation (ITU]), we can get for any j, / G Z> 

AT (1) -(1) N (1) -(1) 

r/1) _ Y^J 1 ) Pl,0y ( (l)v _ V^, (2) Pl,0 y, Pl,0 y , (2)s ~(2) 

k=i Po,o Po,o k=l Pofl Po.o 

Therefore Tl ans {h) = T t r rans (I 2 ) for any r G Z> . 

<= If T[ rans (Ii) = T r trans (I 2 ) for r > 2N-2, from Corollary^ we conclude that P{ ans = P 2 rans , 

\ V fc,t™ns> rlK^kjrans) J J k=l \ \ k,transi r2\^k,trans) J J k=l' 

Hence 3z ,z' G C s.t. z£ trans = + z , z$ rans = zf + z' with Pi(z$ rans ) = Pi{z£ ] ) and 

(2) (2) 

Pz( z k trans) = P2\ z k) f° r an y ^ = 1) 2, . . . , iV. Without loss of generality, we assume that 
z k}rans = z k}rans and Pi(4!LnJ = P2(4?LnJ- Therefore 3z - z' G C = G satisfying 

Z k ] + Z ~ z = z k\ PA Z k ] + Oo - 4)) = Pi (4 ) = P2(4 2) )' 

i.e. 3(7 = ^q — z E G = C such that g o l x = l 2 . □ 

Remark: Without loss of generality, we can assume that the two images have the same num- 
ber of pixels by simply adding zero valued pixels to the smaller image. 

Example 2: Consider the action of G = M. + on C by scaling 

(A, z) h-> \z, VA G G,Vz G C. 
Then the induced transformation on the image / = { (z^, p(zk)) } k _ 1 is 

\o{(z k ,p(z k ))}^ =1 = {(\z k ,p(zk))}" =v VAGG. (11) 



In other words, the image is scaled by a factor A both horizontally and vertically. Then the 
transformed complex moments are 
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N 



N 



fc=l 

N 



k=l 



N 



k=i k=i 

= p J , l \ 1+l , Vj,/GZ> . 
Written in matrix form, the moment matrix for the new image / after scaling is 





(1 











\ 




(i 











\ 







A 















A 










r N (I) = 








A 2 







Mi) 








A 2 









v° 






x N - 


V 




v° 






\ N ~ 


7 



Again, we use the moving frame method of Fels and Olver to obtain a set of invariant 
functions of the moments. Notice that fii t i = J^feLi ZkZkp(zk) = J2t=i ipi + ilVjPi^k) ^ 
unless all p(zk) are zero. We consider the cross-section defined by pi t \ = 1. The group 
transformation that maps tn(I) to the cross-section is the moving frame A = (/ii t i)~^. By 
applying the moving frame to the moment matrix, we obtain the matrix 



(I 

\o ■■■ 








\ 



Mi) 



o (ni,i)—t-J 



(\ 
\0 ••• 








\ 



By equivariance of the moving frame, all the entries of f N (I) are invariant under scaling. 

By normalizing the coordinates of T r (I), we obtain the scaling invariant Pascal Triangle 
Tg Cale (I) for a discrete image J: 

^0,0 

A*0,l/ y/ 1*1,1 1*1,0/ y/fJ-1,1 

1*0,2/1*1,1 2 ^2,0/^1,1 

3333 
/W/^i.i 3/ii i2 /^i 5 i 3^ 2 ,i/Pi 2 ,i aW^i.i 

P0,4/lA,l 4/^1,3/^,1 6^2,2/^,1 4/13,1/^^ H4,o/l4,i 



P^r/ 1*1,1 (0 l*l,r-lj 1*1,1 ■■■ (i) l*l,r-l/ 1*1,1 (r - i) /V-l,l/^i,i ^r,0/Vl,l 
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Observe that the corresponding n-th order normalized moment rh n (8) = m n (^)//x 1 2 1 is in- 
variant under scaling. 

Lemma 6 (Orbit Separation Property of T™^ 2 (I)). Let h, I 2 be two discrete gray scale 
images with the same number N of pixels. There exists a scaling g G 1R+ such that goI x = I 2 , 
where o is defined as in (EP T r scale {h) = T r scale (I 2 ) for r > 2N - 2. 

Proof. =>- If 3 g G G such that g o ^ = J 2) we have zj® = \z*jp and pi(z^') = p 2 (z^) 
for some A G M + , k = 1, . . . , N. Since for Ii and I 2 , the corresponding scaling invariant 
moments are 



flW E^^')^ 2 ')'^') 

Et 1 (A4 1| )'(A4 1, )V I (4 1) ) Et 1 ^ + '(4 1, )'(4 I> )Vi(4 1) ) 



(EL(A4 1, )(A4 1) )p 1 (4 1, )) i * (Et 1 A 2 4"*Vi(4 1) )) 1? 



fl w 

Therefore T r scale {I x ) = T scale (I 2 ) for any r G Z> . 

^= If T lcaie(h) = T r scale {I 2 ) for r > 2N - 2, from Corollary OQ we conclude that If ' 6 = If a ' e , 

{ ( Z fcica«e' Pl( Z iJca«e)) }fc=l = { Jcaie' P2 (^IJcaZe)) } fc=l • 

Hence 3Ai,A 2 G M+ s.t. z£Lz e = *i*k\ 4!Lfc = with Pi(4!Lz e ) = Pitf^ and 

^(4?Lie) = for any fe = 1, 2, . . . , JV. After relabeling, we have z£L*e = 4?Lie and 

Pi(4!Le) = P2(4 2 LJ- Then 3^ G M+ = G satisfying 

(l)Al _ (2) /J1) A 2n _ / _ / (2k 

i.e. 35f = ^GG = lR + such that goI l = I 2 . □ 
More generally, consider the action of group G of diagonal matrices on by scaling 
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Then the induced transformation on the image I = { {z k , p(z k )) } k _ 1 is 

A 2 ) ° {( Zk > p ( Zk ^}k=i = {( X i x k + i^yk,p(zk))}k =v V^ 1 Q G G, z k = x k + iy k . 
In other words, the image is scaled by a factor Ai horizontally and scaled by A2 vertically. 

Notice that after the transformation, the pixel coordinates become 

x . x x z k + z k . z k — z k Ai + A 2 Ai — A 2 _ 
z k = Mx k + i^2Vk = Ai — - h i\ 2 — — — = — - z k H - z k , 

- , z k + z k z k -z k Ai - A 2 , Ai + A 2 _ 

Zk = Mx k ~ i^2Vk = Ai — 1X2 — — — = z k H z k . 

I Zl I I 

Then we have the transformed complex moments 

fJ>j,i - 2_^z k z k p\z k ) - { 2 Zk H 2 ' ^ 2 2 ' P\ z kh 

k=l k=l 
N 3 / .\ \ 1 \ xx 2 



= £/>(**)[£ ft) <^)'4(^r-ci[E (0 (^)'4(^)'-'4-'], 

fc=l s=0 V / _ f=o ^ ' 

fc=l s=0 t=0 \ / \ / 

= EE ft) ft) (^)'- ,+ *(^)-' + '[E"(^)4 + '4 + '-"], 

s=0 t=0 ^ ' ^ ' " " fc=l 

^7 E E («) (0 + - A 2 ) J - s+ W^ + ^ s -*, Vj, I G Z> , 



2i+ l 

s=0 t=0 

which is a linear combination of the last row of the Pascal Triangle T^ +l (I). 
Example 3: Consider the action of G = {z G C||;z| = 1} on C by rotation 

(e ie °,z) ^ ze ld \ W 9 ° eG,Vze C. 
Then the induced transformation on the image / = { (z k , p{z k )) } k=1 is 

e te ° o { (z k , p{z k )) } N k=1 = { {e id °z k , p{z k )) f k=v W e ° G G. (12) 
In other words, the image is rotated counterclockwise with an angle 9 . The transformed 
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complex moments are 



N 



N 



k=l 
N 



k=l 



N 



k=l 



k=i 



Written in matrix form, the moment matrix for the new image I' after rotation is 

(\ \ /l ••• \ 



Mi' 



e~ ieo 

e- i2e ° ■■■ 












e -i(N-l)0 o j 



tn(I) 



e i6 ° 
e i2e ° 












e i{N-l)6 j 



Now we will use the moving frame method of Fels and Olver to obtain a set of invariant 
functions of the moments. If /io,2 7^ 0, we normalize the imaginary part of fi' 02 to zero by 
specifying the rotation angle 9 . Since fi' 02 = yUo^e -4260 , looking at /7 ,2 as a vector in R 2 
representing the complex number /z ,2, we set 

26 = «ju ,2, ei) + 2kn, k G Z. 

Here <(x,y) = tan -1 (^) — tan~ 1 (^-) denotes the angle from x to y, e\ = (1,0) T is one of 
the standard basis of M 2 . The real part of fi' 02 then reduces to its magnitude |/^o,2|- 



Since 9 G (— 7r,7r], 29 G (— 27r, 27r]. To uniquely determine the value of 6*o, we consider 
Hi 2 = Hi,2£~ ie ° ■ We choose 6*o such that Re(// 12 ) > 0, which leads to the moving frame 
formulae 

f§<0"o,2, e*i) if <(/Zi, 2) e*i) - |<(/2 , 2 , e\) G 

|<(/*Q,2, e*i) + 7T if <(/2i, 2 , el) - |<(/2 , 2 , ei) G 

)■ 

By applying the moving frame to the moment matrix, we obtain the matrix 



2' 2-1' 
7T 37T ] 

2 ' 2 J' 

37T 7T 1 

2 ' 2- 



(13) 



A o 



r' N (I) 














-i26 



o 



o 
o 
o 

-i(N-i)e 



\ 



tn(I) 



(\ 

e ie ° 







J29 













with 6*o satisfying f[T3"j) . By equivariance of the moving frame, all the entries of t' n (I) are 
invariant under rotation. 
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By normalizing the coordinates of T r (I), we obtain the rotational invariant Pascal Triangle 
Trotate(I) f° r a discrete image J: 

A*o,o 

1/^0,2 1 I A*2,Q | 

/^0,3 e -3/^1,26 0/i 2i ie /i3,0 e 

/io,4e 4/ii i3 e o/i2,2 4/i 3i ie /^4,oe 



Observe that the corresponding n-th order moment m' n (8) = m n (8 — 9q), with 8q defined as 
in (fT3|) . is invariant under rotations. 



Lemma 7 (Orbit Separation Property of T^ t ~ t l{I)). Let I\,I 2 be two discrete gray scale 
images with the same number N of pixels. There exists a rotation g G {z G C\\z\ = 1} such 
that g o I\ = I 2 , where o is defined as in [W\l -<=>■ T^ otate (Ii) = T^ otate (I 2 ) for r > 2N — 2. 

Proof. =>- If 3 g G G such that g o I x = I 2 , we have zj: 2 '' = z^e* 6 * and pi(z^) = p 2 (z^), for 
some ^0 G {-2 G C||^| = 1}, k — 1, . . . , N. For Jx and ^2, the corresponding scaling invariant 
moments are 

fc=i 

AT 
k=l 

N 

fc=l 

JV 

fc=i 

Since /1q 2 = jj^le~ t2eo , /j,f 2 = /i^e"* 6 * , we have 
<(/4 2 i,e 1 ) = <(/4 1 j,ei)-20 o + 2A;i7r, <(/Z$, ei) = <(/Z$, ei) -0 o + 2£; 2 7r, h,k 2 eZ. (14) 
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Notice that <(/4 2 > ^i)> ^(/n 2> ^i)> G ( — 7T, 7r], for Z = 1, 2. Hence fci, fc 2 = 0, ±1. To decide 
6 1 and 9 2 , we consider 

<(M% Si) - ^<(/lg, ex) = <(/Z$, ei) - ±<(/2<g, ei) + (2fc 2 - fc^Tr (15) 
by using (fT4l) . 

If <(/ii 2 2,e*i) — ^<(/4 2 2,ei) ^ [— fj|]j from ([TBI) we know that 02 = |<(/4 2 2> ei)- Since 
<(42> ei) - ±<(/Z$> ei) G ], then2/c 2 -/ci is either or ±1 in (J33J. If A* = 0, A& = 0, 



there is <{j2^l, ei) — §<(a*02j ei) G [— f , | ]. Hence Q\ = |<(/to2) ei)- Then from (fUjl we have 
2 = 6i - e . Thus /zg } = EjLi(4 1) ) i (4 1) )Vi(4 1) ) e<W " * 1 = If fc i = = 0, there 
is <(/z£a>ei) - K/^ei) e (f > f ]■ Hence #i = i<(^o5>ei) + Then from dH we still 
have 9 2 = Q\ — 6 Q . Thus pt?J = fx^J. If k\ = l,k 2 = 1, there is <(fti^, ei) — |<(^2> ^i) e 
[-^, -f). Hence 0i = ^(/i^, ei) - vr. Then from (JHD we have fl 2 = # x - O + 2vr. Thus 

^ = EL L (*fW)W^-° fc =/iS ) - 

If <(4%ei) - |<(/4% ei) G (f, f ], from flTJ) we know that 9 2 = §<(/2$, ei) + vr. Since 
<(M!iei) - K^ei) G [-f then 2/c 2 - fci = 0,1,2 in (03). If fc a = l,fc 2 = 1, 
there is <(/i^ 2 ,ei) — |<(/4*25 e*i) G [— f,f]- Hence #i = |<(/?o^ 2 , ei). Then from ( 1T3|) we 
have 9 2 - it = 6, - 6 + tt.' Thus = ELC^)^^)^^^)^ '- ' 1 = H = 

0,fc 2 = 0, there is <(^,ei) - §<(/2$,ei) G (f , f ]. Hence X = ei) + vr. Then 

from (JTJI we have 9 2 — tx = 9% — 9 — tx. Thus /t^ = /t^. If k\ = 0, k 2 = 1, there is 
<(MS»ei) - K^ei) G [-f , -f). Hence X = §<(/2$,ei) - vr. Then from flU} we have 
02 - n = 9, - 9 + n. Thus /$> = ^'(tf ^(^V^ 1 = 

If <(/Ii 2 2 , ei) — !<(/4 2 2 , ei) G [— — ~), through the similar discussion, we can still conclude 
that fifj = fifj. Therefore T r scale {h) = T r scale (I 2 ) for any r G Z> . 

If T; otate (h) = T; otate {I 2 ) for r >2N -2, from Corollary QJ we conclude that I{ otate = 

jrotate j g 

m w -i(V 2) ^ (2) 

\ V'k.rotatei PK^k, rotate) J S k=\ I \ k,rotatei ry^k, rotate) ) { k=V 

Hence 3^,0 2 G G C||z| = 1} s.t. ^ oiaie = 4V<\ 4% tate = zfe^ with pi(^ otate ) = 



Pi(4 ) and p 2 (^ rotate) = P*{ z k ) ^ ^ = 1, 2, . . . , iV. Without loss of generality, we 

(i 

assume z k 
satisfying 



assume z ( ^ rotate = z$ otate and Pi(z^ otate ) = p2(zfl otate ) . Then 39 1 -9 2 e {z e C\\z\ = 1} = G 



i.e. 3 ^ = e*^ 1 - 02 ) e G = {z e C\\z\ = 1} such that goI x =I 2 . □ 
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In conclusion, we have the translation, scaling and rotation invariant Pascal Triangle T[ nt (I): 

fa,o 

fa,ie~ i6 ° I 'y/Jh~i h$e i6 ° / \ffa~i 
1^0,21/^1,1 2/ii i i//ii i i \fa,o\/fii,i 

fae-** /^ Zh,2e~ m /Ai *fa&*°/Ai fafl^/A,! 
h£e~ m °lft,i ^e-™ /^ G fa*/ ft,! Ifaie™ /^ /Hoe i49 °//^i 

fa,** 90 / ■■■ (dhr-ie-**-** 90 /^,! ■■■ Ar,oe ireo /Ai § i 

where jljj is the central complex moment and Qq satisfies ( fTBl) . 

5 Geometric Interpretation of the Moments 
5.1 Shape Elongation 

Intuitively, the elongation of a shape is described by the relationship between its length and 
its width. It is thus a property that is invariant under translation, scaling and rotation of 
the image. To characterize the shape elongation, we therefore consider the invariant izat ion 
fh' 2 {9) of the second order moment rri2(0) with respect to translation, scaling and rotation. 
By combining the results of Examples 1, 2 and 3, we have 

rh' 2 (6) = I(^e* 2e + 2 + \M e ~^ 
4 /ii,i //i,i 

= 7(^(cos(2#)+*sin(2#)) + 2 + !^(cos(2#) - isin(20))), 
1 (2^^cos(20) + 2), 



4 fa,i 

1 / \fa,2\ 

2 fa,i 



cos(2#) + 1), (16) 



where 



AT N 



fa,i = ^2( z k ~ z ){z k - z )p{z k ) = ^ (i x k - %o) 2 + {Vk ~ yof)p{zk) > 0. 



k=l k=l 
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Recall that when making the moments scaling invariant, we normalized /i^i to 1 by dividing 
each jijj by -v/ Mi,i ■ Hence represents the scale of the image. 

Equation ffl6l) indicates that the quantity prescribes the relationship between the max- 
imum and the minimum values of the standard deviation of the random transform. It thus 
gives us a quantification of the elongation of the shape illustrated by the image 4 . 



Lemma 8. If not all p{zk) are zero, then < M < 1. 



Proof. By definition, |/x , 2 | > and fi ltl > 0, hence Jg^i > 0. If > 1, since tft£(0) = 
|(Jgi2l cos(20)+l), and m' 2 (0) > by definition, if we choose 9 = f , then M C os(20) + 1 < 0, 

which is a contradiction. Therefore < 1. □ 

w,i — 

The case = 1 corresponds to the most extreme elongation, namely the straight lines. 

Lemma 9. The pixel coordinates z^ lie on a single straight line if and only if = 1. 

Proof. =>■ Suppose we have a straight line. As the line is put vertically, the projection of the 
line is a dot. Hence the second moment of the radon transform is zero at that angle 9*, i.e. 

^/ (r) = I(J^1 008(2(9*) + 1) = 0. (17) 

Since — 1 < cos(20*) < 1 and from Lemma [8] we know that < — 1 f° r an y image, we 
can conclude that (117j) is true only when = 1 and cos(20*) = — 1. Hence = 1 is true. 

<= Now suppose = 1. Combine the results in Examples 1, 2 and 3, we conclude that 
rh' 2 (6) = m 2 {9 - o )/Ai,i = ^(^cos(20) + 1), M9 G (~, \ 

where 9q satisfies ( ITBl . Since rh' n (^) = 0, then there is 9 = ~ — 9 such that at this angle the 
centralized second order moment rfi2(9) of the image is zero. 

Let the Radon transform fg(r) at angle 9 be a discrete function. Without loss of generality, 
we assume that YLk=i fe{ r k(.@)) = 1 an d f§{ r k(9)) > 0. Since 

N 

rh 2 {9) = $> fc (0) - ro(e)) 2 fe{r k (9)) = 0, 

k=l 



4 A. R. Rostampour et al. |4| previously introduced the as a measure of elongation of the projections 
of an image. We observe that our measure of elongation has a lower order, and that it can be obtained 
without normalizing the angle of the image. 
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where r (9) is the projection of the centroid of the image, we observe that f§(r) = S(r—r (9)). 
Then we conclude that the image lies on a line through r (9) with angle 9 + | to the x- 
axis. □ 

The other extreme case is when = 0. This corresponds to fh' 2 {9) = constant, so the 
standard deviation of the projection is the same for all directions. There are many ways for 
this to happen. One interesting case is the discrete analogue of rotation symmetries. 

Definition 2. An object is said to have N-fold rotation symmetry (N-FRS) if it is unchanged 
by a rotation around its centroid by for all k = 1, . . . , N. 

Lemma 10. // the image I has an N-FRS with N > 2, then = 0. 

Proof. Suppose the data have iV-FRS. For a certain point with distance r^, k — 1, 2, ... , M, 
from the centroid, angle 9k with x-axis and weight p(zk), there are — 1 more points 
with the same distance from the centroid and the same weight p(zk) but having angle 
9 k + j — 1, . . . , N k — 1 with x-axis respectively. Then the moment //. ,2 can be written 

as 




It can be shown that 

JVfc-l , ■ JVfc-l , ■ 

Y cos(4^) = 0, V sin(4^) = 0, ViV fe > 2. 

j=Q K j=0 K 

Then fi Qy2 = 0, hence Jgi = 0. □ 
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One can give a statistical interpretation of our proposed shape elongation measure 

Indeed after renormalizing the total ink // ,o = J2k=i P( z k) to one, one can view the pixel 
intensities as describing a discrete probability distribution. The standard deviation matrix 
of that distribution is then determined by the third row of the Pascal Triangle, as stated in 
the following Lemma: 

Lemma 11. Consider the discrete image I as a bivariate distribution with the joint proba- 
bility mass function P(X = x k — x , Y = y k — y ) = k — 1, 2, . . . , N. The covariance 
matrix E of that distribution is given by 

' ftl,l + ite(/j , 2 ) Im{fk),2) 
2/io,0 2/io,o 

-f™(Ao,2) jh, l—Re(P*),2) 
2/^0,0 2/lo,0 

Proof. Observe that 

^ = f> - z,){z k - z )^ = J2 {(*k - *o) 2 + (y k - Vo) 2 )^, 
Po,o fc=1 /io,o fc=1 /xo,o 

P0,2 V^/- - \2P( Z k) // \2 / \2\P( Z k) o'W \ ( \P( Z k) 

Write E = ( ' PxY^x^y \ ^ gj nce ranc } om variables X, F both have zero mean, 
\pxy(y x o y a z y J 

we have 

°l = ^2( x k -x ) 2 ^^-, a 2 y = ^T(y k -yo) 2 ^^-, PXY^xVy = ^2(x k -x )(y k -y ) P ' "' 



fc=l ^o- fc=l ^o- fc=l ^ 

Then one can check that 

A*i,i , Re(/2o, 2 ) 2 Im(/io,2) Ai.i Re(/2 , 2 ) 2 

o 1 o ~~ °^ o ~~ Pxvcr x a y , a . 

^Po,o ^Po,o ^Po,o ^Po,o ^Po,o 

□ 

Recall that, in order to obtain the standard deviation m 2 (#) of the projection of a bivariate 
distribution onto the line with direction vector (x, y) = r(cos 9, sin 9), one can simply project 

(cos 9\ 
sin# ) = m2 ^' 

It is easy to check that the relationship between the shape elongation and the eigenvalues 
A ma:c , ^min of the standard deviation matrix E is 2 A ' A 



max ^mm 

min 
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5.2 Rotational Symmetry 



We have seen in the last section that an image I having an iV-FRS has flo,2 = 0. More 
generally, we have the following lemmas, which was used in j5] as the basis for a HAZMAT 
sign recognition method. 

Lemma 12. 5 Let N be a (finite) integer. If an image I has an N-fold rotation symmetry 
and if ^ is not an integer, then jljj = 0. Conversely, if jljj = for all that are not an 
integer, then the image I has an N-fold rotation symmetry. 

Proof. =^ Let us rotate I clockwise around the origin by Due to its symmetry, the 
rotated image I' must be the same as the original one. In particular, it must hold 

~l _ 2-Ki{l-j)/N~ ■ ~ 

rj,i — e ^3,1 — 

Since is not an integer, this equation can be fulfilled only if fyj = 0. 

-<= Suppose fij t o = for any i not an integer of some finite integer N. Let us rotate I 
clockwise around the origin by ^ for each k — 1,2, . . . , N — 1, then fl'j = e ~ 2m i k / N Jx^q for 
each k and all j — 0, 1, . . . , N — 1. For ^ G Z, it is easy to check that e - 2m i k / N = 1 ; hence 
fijQ = fijfl. For ^ ^ Z, i is not an integer either. Then jlj i0 = = jl'j . In this way we 
have fij g = ft>j,o for all j — 0,1, . . . , N — 1. Since in the proof of Lemma [U we showed that 

{/^i.oj^-Q 1 uniquely determine /, then we can conclude that I and I' are the same for any 

rotation with angle k — 1,2, . . . , N — 1. Therefore the image / has an A^-fold rotation 
symmetry. □ 

Remark: As increases, more and more columns of the Pascal Triangle T r (I) becomes 
zero, so that in the limit — > oo, all entries fijj with j ^ I of T r (I), for any order 
r, vanish. This limit case corresponds to oo-fold rotation symmetry (e.g. circles), which 
however does not occur among discrete images. 

5.3 Reflection Symmetry 

Consider the reflection of an image about the line through the origin with direction vec- 
tor (cos(#) sin(6 1 )) , 9 e (— f,f]- The point z k = x k + iy k is mapped to z k = z k e l2e = 
{x k cos(2#) + y k sin(26 1 )) + i{x k sin(2^) — y k cos(26')) under the reflection with its pixel inten- 

5 An analogue for the "if part of this lemma for the case of a continuous image can be found in [6 
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sity p(zk) staying the same. Then the new complex moment is 



N 



N 



k=i 

N 



k=l 



N 



k=i 



k=i 



= n u e-" Vj,Z E Z> . 

Therefore the moment matrix for the new image J after reflection is 

/l ••• \ /l 

e" i2e ••• 







-iA6 







q e -*2(JV-l)9 



e i2e 
e i4e 



\ 






e a(N-\)$ 



We can conclude from the above relation that if an image is symmetric with respect to the 
x-axis (i.e. 6 = 0), then we will have tn(I) = tn(I) t , i.e. p^\ = pij for all j, I G Z> . Since 
Pj,i = Pi,j by definition, this means that all the Pj/s are real. 

Similarly, if an image is symmetric with respect to the y-axis (i.e. 9 = |), we can conclude 
that Pj/s are real for j, I of the same parity and Pj/s are imaginary for j, I of opposite parity. 

More generally, we have the following result: 

Lemma 13. A discrete image is symmetry with respect to reflections about a line through 
the origin with direction (cos 9 Q sin# ) 

<=► tan(/-j)^o = -^4, j,l = 0,l,.... 

Re{p jt i) 

Proof. Notice that with reflection symmetry, we have 

m n (6 -6) = ^ j^{z k e-^ + z k e^ d Yp^k), 



k=i 

N 



k=i 
i N 

On ^ ;(^fc^ 



) n p(z' k e i2e °), (denote z' k = z k e 



k=l 
N 



= ^E(^ 0+9) + 4e^ +f?) )>(4), 

k=l 

= m n (9 + 9). 
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Conversely, if m n (9 — 9) = m n (# + 9) for an image I — { (z k , p(z k )) } k _ v then for its reflec- 
tion image I r = { (z k e l29 °, p(z k )) } k=v there is m r n (9 + 9) = m n (9 - 9) = m n (9 + 9) for any 
9 G (— 7r, 7t]. From Lemma [1] and Lemma H we can conclude that the image reconstructed 
from {m r n {9j),j = 1, . . . , n + and {m n (0j),3 = 1, . . . , ra + lj^Tg will be the same, i.e. 

I r = I. Hence the image has reflection symmetry. 

By Equation ([7]), we know 
m n(9 Q + *) = ^ £ (?) »i,n-ie* n -^\ m n (9 - 9) = 1 £ (fl ^e^^. 

1=0 ^ ' 1=0 ^ ' 

Then m n (9 + 9) = m ra (# — 9), i.e. m n (9 + 9) — m n (# — 0) = can be written as 
£ (?) »i,n-ie i(n - 2l)9 ° (2< sin(n - 21)0) = 0, 

£ (?) R«-^ (n ~ 2Z)e ° sin (™ - 2l )0 = 0, 

\ n ~ 1 \ 

£ (?) sin (™ - 2i)« (W.n-ie^ 20 * - ^-i,ie^ e °) = 0, 
j 

^ £ (") sin ( n " 2O02iIm(^_,e i ^ 2, ) flo ) = 0, 
i=o ^ ' 

sin(n — 2/)6 l o + Im(/i^ n _^) cos(n — 21)9$) = 0. 

z=o ^ ' 

The above equation is true for any 9 G (— f , f ], so it is true if and only if 

— 1 

Re(/i /jn _/) sin(n - 2l)9 + Im(/^ n _j) cos(n - 2l)9 = 0, / = 0, 1, . . . , [ - j , 

i.e. 

tan(n - 21)9, = - ^fa^ , / = 0, 1, . . . , . (18) 

Since // n _y = /2z,n-z> ([IB} can be written as 

tan(/-j)^o = -^4, Vj=0,l,..., 1 = 0,1,.... (19) 

□ 



25 



In this way, for a given discrete image, we can check ([19]) to decide whether it is symmetric 
with respect to a certain line or not. If it is, then the line is at an angle 9 given by 



Q = \ arctan(-§gj±ij) if Re(^., +1 ) ^ 0, Vj = 0, 1, . . . , 
1 | otherwise. 
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